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Abstract 

Let p is a cuspidal representation of GL{n, F), with F a non archimedean local field, and 
H a maximal Levi subgroup of GL{n,F). We show that if p is iJ-distinguished, then n is 
even, and H ~ GL(n/2, F) x GL{n/2, F). 



1 Preliminaries 

Let F be iioiiarchimedeaii local field. We denote GL{n,F) by G„ for n > 1, and by Nn the 
unipotent radical of the Borel subgroup of Gn given by upper triangular matrices. For n > 2 we 

denote by Un the group of matrices u{x) — ^^""^ for x in 

For n > 1, the map g i— > ^ ^ is an embedding of the group G„_i in G„, we denote by P„ 
the subgroup G„_iJ7„ of G„. 

We fix a nontrivial character 9 of {F, +), and denote by 9 again the character n H> ^(X]r=~/ "■i.i+i) 
of Nn. The normaliser of 9\ij^ is then P„_i. 

When G is an /-group (locally compact totally disconnected group), we denote by Alg{G) the 
category of smooth complex G-modules. If (tt, 1/) belongs to Alg{G), H is a, closed subgroup of 
G, and x is a character of H, we denote by Sh tire positive character of Ng{H) such that if fi is 
a right Haar measure on H, and int is the action given by {int(n)f){h) = f{n~^hn), of Ng{H) 
smooth functions / with compact support on H, then fi o int{n) = Snin)^ for n in Ng{H). 
If iJ is a closed subgroup of an Z-group G, and (p, M^) belongs to Alg{H), we define the object 
{ind''^{p),Vc = ind'^{W)) as follows. The space Vc is the space of smooth functions from G to 
W, fixed under right translation by the elements of a compact open subgroup Uf of G, satisfying 
f{hg) — p{h)f{g) for all h in H and g in G, and with support compact mod H . The action of G 
is by right translation on the functions. 

If / is a function from G to another set, and g belongs to G, we will denote L{g)f : x M- f{g^^x) 
and R{g)f : x >-> f{xg). 

We say that a representation tt of G is _ff-distinguished, if the complex vector space HomuiT^, 1) 
is nonzero. 

We will use the following functors following |B-Z) : 
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• The functor from Alg{Pk-i) to Alg{Pk) such that, for tt in Alg{Pk-i), one has $+7r = 

• The functor 5'+ from ^^^(G/c-i) to Alg{Pk), such that for tt m AZg(Gfe_i), one has ^f+Tr = 

We recaU the foUowing proposition, which is a consequence of theorem 4.4 of jB-Zj . 

Proposition 1.1. Letn be a cuspidal representation ofGn, then the restriction ir^p^ is isomorphic 
to 



2 The result 

Suppose n = p + q, with p > q > 1, we denote by M(^p q^ the standard Levi of G„ given by 
h„ 



matrices , j with hp e Gp and hq G Gg, and by Af(p the standard Levi of G„_i given 
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by matrices ^ ^ with Zip e Gp and /iq-i G Gq_i. We denote by M(p_i the standard 

Levi of G„-_2 given by matrices ^p~^ ^ ^ with /ip_i G Gp_i and G Gq_i. 
Let Wp^q be the permutation matrix of G,i corresponding to the permutation 

1 ... p-q p-q+1 p-q + 2 ... p-1 p p+1 ... p + q-2 p + q-l p + q 

1 ... p-q p-q+1 p-q + 3 ... p + q-3 p + q-1 p — q + 2 ... p + q ~ 4 p + q-2 p + q 

Let Wp,q-i be the permutation matrix of G„_i corresponding to the permutation Wp^q restricted 
to 1}: 

1 ... p — q p — q+1 p — g + 2 ... p—1 p p+1 ... p + q~2 p + q~l 

1 ... p~q p — q+1 p~q + 3 ... p + q-3 p + q—1 p — q + 2 ... p + q — A p + q-2 

Let Wp„i_q_i be the permutation matrix of Gn-2 corresponding to the permutation 

1 ... p — q p — q+1 p — q + 2 ... p — 2 p—1 P ■■■ P + q — 3 P + 9 ~ 2 

1 ... p — q p-q+1 p-q + 3 ... p + q-5 p + q — 3 p — q + 2 ... p + q-A p + q-2 

We denote by Hp^q the subgroup Wp^qM(^p q-)Wp q of G„, by Hp^q^i the subgroup Wp^q-iM(^p q_i)Wp q_^ 
of G„_i, and by i/p_i^,_i the subgroup Wp-i^q-iM(p_i^q_i-^Wp\ q_^ of G„_2. 

The two fohowing lemmas and propositions are a straightforward adaptation of Lemma 1 and 
Proposition 1 of [KJ. 

Lemma 2.1. Let Sp^q — {g G G„_i, Vu G Un n Hp_q, 9{gug^^) = 1}. Then Sp_q = P„_ii?p,g_i. 

Proof. Denoting by Ln-i{g) the bottom row of g, one has 9{gu{x)g^^) = 6{Ln^i[g).x) for u[x) 
in Un- Hence 0{gug^^) = 1 for aU u in C/„ n Hp q if and only if g-n-i.j — for j — p — q,p — q + 
2, . . . ,p + q — 2. It is equivalent to say that g belongs to P„_ii/p_q_i. □ 

Lemma 2.2. Let Sp^q-i = {5 G G„_2,Vu G Un-i n Hp^q^i, 9{g^^ug) = 1}. Then Sp^q = 

Pn-2Hp-i^q^l. 

Proof. Denoting by Ln-2{g) the bottom row of g, and by u{x) the matrix ^^"q^^ 'j'^ i sothat 

9{gug^^) = 6{Ln-2{g)-x). Hence 9{gug^^) = 1 for all u in C/„_i DHp^q^i if and only if g„_2,j — 
for j — 0,l,...,p — q,p — q + 1 and j = p — q + 3,p— q + 5...,p + q — 5,p + q — 3. It is equivalent 
to say that g belongs to Pn-2^p-i,g-i- CH 
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Proposition 2.1. Let a belong to Alg{Pn-i) , and x be a positive character of Pn H Hp q, then 
there is a positive character %' of Pn-i H Hp ^^i, such that 

i?omp„nHp,,(*+cr,x) ^ iJomp„_inHp,,-i(o-,x')- 

Proof. Let V be the space on which a acts, and W = (f>'^V. Let A the projection from C^{Pn, V) 

onto M^, defined by A{f{p)) — Jp 6^^^"^ {y)a{y~^)f{yg)dy. Lifting through A gives a vector 

space injection of Homp^rtHp ^{^^ cr^x) i^ito the space of ^-distributions T on P„ satisfying 
relations 

T o R{ho) ^ xiho)T (1) 

roL(yo) -4/'(yo)Toa(2/o) (2) 
for Hq in f„ n Hp^g and yo e Pn-iUn- 

We introduce the map on P„ defined by 0{ug) = for w in U„ and g in G„_i. Then the 
X^-distribution G.T is [/„-invariant, hence tlrere is a 1^-distribution 5 with support in Gn-i such 
that 9.T = du® S (where du denotes a Haar measure on f7„), and thus T = Q^^.du (E> S has 
support f7„.supp(5). It is easely verified that du® S is invariant-f7„, but because of relation ([I}, 
T is invariant- (t/„ n Hp q). We deduce from these two facts that for g in supp(iS'), Qigu) must be 
equal to Q{g) for any u in Un H Hp q. This means that supp(S') C S'p.g, and Sp^q ~ Pn-iHp q^i 
according to Lemma |2TI hence T has support in Pn^iUnHp,q~i- 

Now consider the projection B : C^{Pn-iUn x Hp^q-i,V) C^(P„_iC/„i/p.q_i, y), defined by 
B{4>){y^^h) — Jp ^^-^ ^ (f'io-yi ah)da (which is well defined because of the equality Pn-iUn n 

Hp.q-i ~ Pn-i n i/p.q_i), and (j) (f) the isomorphism of {Pn-iUn x Hp q^i, V) defined by 

Hy,h)^xih)SuAy)'^'<jiymy,h). 

If one sets D{(f>) — T{B{(t))), then is a V^-distribution on P„_i[/„ x Hp q^i which is invariant- 
Pn^iUn x Hp This implies that there exists a unique linear form A on V . such that for all 

Now for 6 in P„_i n Hp ^^i, on has from the integral expression of D, the relation Z) o L{b, b) = 
S{b)D for some positive modulus character S. On the other hand, writing D as ^ T{B{(j))), 
one has L{b,b)(f> ~ xib)Sij'^ {b)L{b,b){a{b^^)(f>) and P o L{b,b) ~ Si{b)B for a positive modulus 
character sothat D o L(6, 6) = Si{b)x(b)Sf/^ {b)D o (7(6^^). Comparing the two expressions for 
DoL{b, b), we get the relation Doa(b) = x'ib)D, with x' being the positive character d^^SixSff^ 

of P„_l n Hp^q^l. 

This in turn implies that the linear form A on 1^ satisfies the same relation, i.e. belongs 
to iJomp^_jn//p ,_i (c, x'): ^ii'i T I— > A gives a linear injection of Homp^riHp gi^^o'TX) into 
Homp^_^riHp g_i (f, x')j ^'^d this proves the proposition. 

□ 

Using Lemma 12.21 instead of Lemma 12.11 in the previous proof, one obtains the following 
statement. 

Proposition 2.2. Let a' belong to Alg{Pn-2)7 o,nd x' be a positive character of Pn-i H Pp^g_i, 
then there is a positive character x" of Pn^2 H Hp-i,q-i, such that 

-ffomp„_inHp,,-i(*+o-',x') ^ -ffomp„_2nHp-i,,-i(o-,x")- 

A consequence of these two propositions is the following. 

Proposition 2.3. Let n > 3, and p and q two integers with p -\- q = n and p — 1 > q > 0, then 
one has Pomp„nHp,,(('I'+)""^*+(l), 1) = 0. 
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Proof. Using repeatedly the last two propositions, we get the existence of a positive character x of 
Pp_,+i such that Homp^nH,Ji^+r-'^+il),l) i/omp^_,^,nff,__,+i,o x) = 

Homp^_^j_^ {{^'^Y '^'"''(1), x), and this last space is because ^^'+(1) and x are two non 

isomorphic irreducible representations of according to corollary 3.5 of |B-Z| . 

□ 

This implies the following theorem about cuspidal representations. 

Theorem 2.1. Let tt be a cuspidal representation of Gn, which is distinguished by a maximal 
Levi subgroup M , then n is even and M ~ Af„/2,n/2- 

Proof. Let M be the maximal Levi subgroup such that tt is A/-distinguished. Then M is conjugate 
to a standard Levi subgroup Afp ^ with p > q and p+q = n. Suppose p > q+ 1 , Mp_q is conjugate to 
Hp q, sothat TT is iJp^g-distinguished, and 7r|p^ is thus iJp^gH P,i-distinguished. But by Proposition 
11.11 the restriction ir^p^ is isomorphic to ($"'')"^^^'+(l), and this contradicts Proposition 12.31 
Hence one must have p — q, and this proves the theorem. □ 
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